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ABSTRACT 

This ;;aper investigates what types of 
instruction-feedback combinations may contribute to the learning of 
English grammar for 120 Japanese university students. Students were 
given tests on grammat ical i ty judgment and correction, using English 
ergative verbs in three trials of a post-instruction test. Subjects 
were divided into six groups according to type of instruction and 
feedback they received. Overall findings indicate that students with 
output instruction plus explicit metalinguistic information 
outperformed Post-test 1 over those with output instruction and no 
feedback. In the grammatically judgment test, the effect of input 
instruction held over 1 week (post-test 2), but output instruction 
had only an immediate (post-test 1) influence on the formulations of 
grammatical knowledge. Finally, input instruction combined with 
either explicit metalinguistic information or positive evidence was 
not found to have significantly more gains in grammatical knowledge 
than output instruction. Educators should keep in mind that providing 
explicit metalinguistic information is a very effective way of 
altering grammatical knowledge of learners when they are engaged in 
output and that the effect of treatment may continue longer for input 
instruction than for output instruction. The test is appended. 
(Contains 18 references.) (Author/NAV) 
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The effects of instruction plus feedback 
on Japanese university students of EFL : 

a pilot study 



Mikio Kubota 

Abstract 

The main purpose of the current classroom research is to 
investigate what types of instruction-feedback combinations may 
contribute to the learning of grammar. The following two 
Research Questions are thus addressed : 

Research Question (1) What type of instruction com- 

bined with what type of feedback will 
have an effect on the formulation of 
grammatical knowledge ? 

Research Question (2) If there is an effect for treatment, 

will the effect hold over the three post- 
test sessions for learners receiving input 
instruction and output instruction ? 

A total of 120 Japanese university students of EFL (English as 
a Foreign Language) participated in the whole investigation. 
They were given two kinds of tests (grammaticality judgment 
test and correction test) on English ergative verbs in Post-tests 1 
(immediately) , 2 (one week after treatment) , and 3 (one month 
after treatment). All the subjects were divided into 6 groups (4 
experimental groups and 2 control groups) , according to the type 
of treatment (instruction + feedback) they received: 
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Group A1 I input instruction + explicit metalinguistic informa- 
tion 

Group A2 : input instruction + positive evidence 
Group B1 ! output instruction + explicit metalinguistic informa- 
tion 

Group B2 i output instruction + positive evidence 
Group Cl I input instruction + no feedback 
Group C2 output instruction + no feedback 
The overall findings resulting from Tests (A) and (B) in this 
research demonstrate that : 

(1) Group B1 outperformed Group C2 in Post-test 1, (2) In the 
grammaticality judgment test the effect of input instruction held 
over one week, but output instruction had only an immediate 
influence on the formulations of grammatical knowledge, (3) 
input instruction combined with either explicit metalinguistic 
information or positive evidence was not found to have signifi- 
cantly more gains in grammatical knowledge than output instruc- 
tion. 

The pedagogical implications are that teachers should keep in 
mind that providing explicit metalinguistic information is a very 
effective way of altering grammatical knowledge of learners 
when they are engaged in output, and that the effect of treatment 
may continue longer for input instruction than for output instruc- 
tion. 

Keywords 

input processing, processing instruction, positive feedback, 
negative feedback, metalinguistic information 

1. Introduction 

Communication-oriented approaches to ESL/EFL classrooms 
have become increasingly popular. One can see the swing of the 
pendulum with regard to the importance of grammar teaching. It 
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seems that recent trends re-emphasize grammar teaching and 
vocabulary teaching. VanPatten (1993 : 436) sketched a model of 
second language acquisition and use, as shown in Figure 1. Three 
sets of processes were described. The first process, called ‘input 
processing,’ involves the conversion of input to intake, which is 
referred to as the subset of input that is comprehended and 
attended to in some way. Input is required as “raw data” for 
acquisition, and input processing is the first step in getting rele- 
vant data to the developing system in some way. The second set 
of processes are accommodation and restructuring that mediate 
the incorporation of intake into the developing system. The third 
set — monitoring, access, retrieval, speech accommodation 
(modifying one’s speech for a particular interlocutor), etc. — 
involves making use of the developing system to create output. 

Figure 1 : A model of second language acquisition and use 

accommodation monitoring, 

and access, retrieval, 

input processing restructuring speech accommodation, etc. 

1 1 1 
input > intake > developing system > output 

Traditional approaches to explicit grammar instruction may 
contain grammatical explanations followed by output practices, 
which actually work on processes involved in accessing the 
developing system, as illustrated in Figure 2. The learner is asked 
to produce when the developing system has not yet had the 
relevant intake data (VanPatten 1993 : 436). 
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Figure 2 : Traditional grammar instruction 

input > intake > developing system > output 

T 

focused pracice 

Input-based approaches to explicit grammar instruction may 
involve consciousness-raising activities where the instruction is 
aimed at developing explicit rather than implicit knowledge. The 
learners are not expected to produce the target structure, only to 
understand it by formulating some kind of cognitive representa- 
tion of how it works (Ellis 1994: 643). VanPatten (1993: 438) 
proposed ‘processing instruction,’ whose purpose is to direct 
learners’ attention to relevant features of grammar in the input 
and to encourage correct form-meaning mappings that in turn 
result in better intake, as shown in Figure 3. The input is pur- 
posefully prepared, manipulated, or structured in the sense that it 
is not free-flowing and spontaneous unlike the input involved in 
communicative interactions. In the same sense, Ellis (1995 : 88) 
used ‘interpretation tasks,’ a comprehension-based approach to 
grammar teaching. 

Figure 3 : Input-based grammar instruction 

input > intake > developing system > output 

t 

processing mechanisms 
T 

focused practice 

Input-based grammar instruction involves grammatical expla- 
nations like traditional instruction ; unlike traditional instruction, 
it focuses practice on correctly intepreting incoming utterances 
and on perceiving and processing those elements in the input that 
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might otherwise be missed, and input-based grammar instruction 
also centers on activities involving structured input (VanPatten 
1993 : 438) . 

VanPatten (1993 : 437) described two processing stragegies for 
second language input processing. 

(1) a word order strategy : 

It seems that both first and second language learners univer- 
sally tend to process the preverbal N or NP as the subject (agent) 
of the verb (action) and the postverbal N or NP as the object. 
v 2) a learner’s attention on content words and elements of high 
communicative value : 

Learners attend to meaning before anything else and as a 
consequence, they prefer to attend to lexical items for semantic 
information rather than grammatical markers that encode the 
same information. 

Following are the guidelines that input-based grammar instruc- 
tion is based on (V anPatten 1993 : 438-439) : 

1. Teach only one thing at a time. 

2. Keep meaning in focus. 

The learner should not be able to successfully complete the 
activity unless he/she has understood the content of each utter- 
ance. 

3. Learners must “do something” with the input. 

e.g., checking boxes, surveying, answering True/False ques- 
tions, making one-word response, making a multiple-choice, 
writing a person’s or object’s name. 

4. Use both oral and written input. 

A judicious combination of oral and written structured input 
provides for the widest net possible in directing learners’ atten- 
tion. 

5. Move from sentences to connected discourse. 

Connected discourse should come later in a lesson rather than 
at the beginning, because it may (a) not allow sufficient process- 
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ing time, or (b) result in noise. By starting with sentences, 
learners have better opportunities to perceive and process the 
grammatical item in focus. 

6. Keep the psycholinguistic processing mechanisms in mind. 

Learners’ focal attention during processing is directed toward 
the relevant grammatical items and not elsewhere in the sentence. 

The first research of processing instruction was conducted by 
VanPatten and Cadiemo (1993a). They examined Spanish direct 
object pronouns in three second-year university level classes. 
Traditional grammar instruction group (n^lb) : 

presentations and explanations of direct object pronouns 
-* mechanical to meaningful to communicative exercises 
in which producing sentences was the focus. 

Processing instruction group (n^l?) : 

presentations, and explanations of object pronouns that 
included a cautionary note not to rely on word order to 
understand sentences -* structured input activities that 
involved interpreting and responding to input. (N.B. : no 
production activities were involved) 

Control group (n^l?) : 

no explicit instruction received. 

The Pre-test and three Post-tests, using a split-block design, 
were given to the subjects as the means of assessing the effect of 
instruction. All tests consisted of both interpretation tasks and 
written production tasks. The comprehension task for all tests 
consisted of 15 aural sentences, and asked the subjects to match 
each sentence they heard with one of two pictures. The produc- 
tion task, including 5 items, asked the subjects to complete a 
sentence according to visual clues. 

The results of ANOVA and post-hoc Scheffe tests show : 

(1) the processing group did significantly better than the tradi- 
tional group and the control group on the raw scores of the 
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interpretation task, and the processing group outperformed the 
traditional and control groups on the gain scores in the three Post- 
tests of the interpretation task. 

(2) the traditional group was not superior to the processing 
group but rather to the control group on the raw scores of the 
production task, and the processing group did significanltly better 
than the control group on the gain scores in Post-tests 1 and 3 of 
the production task. 

Thus, it can be stated that processing instruction had an impact 
on the developing system and what the subjects could access for 
production, whereas traditional instruction had an. effect on what 
the subjects could access for production, but it had little impact on 
the developing system. 

VanPatten and Cadierno (1993b) replicated VanPatten and 
Cadierno (1993a) , including more subjects per experimental cell. 
The acquisition of Spanish syntactic items (direct object pro- 
nouns) by second-level university students learning Spanish as a 
Foreign Language in America was investigated. There were three 
groups compared : 

Traditional grammar instruction group (n — 26) : 

presentations and explanations of direct object pronouns 
-> mechanical to meaningful to communicative exercises 
in which producing sentences was requested. 

Processing instruction group (0 = 27) : 

presentations, and explanations of object pronouns that 
included a cautionary note not to rely on word order to 
understand sentences -»■ structured input activities that 
involved interpreting and responding to input. (N.B. : no 
production activities were involved) 

Control group (n = 27) : 

no explicit instruction received. 

The differences between the two experimental groups were that 
(a) the processing group was told that language learners often 
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misinterpret NVN sequences, and (b) the traditional group did 
not practice interpreting sentences, and the processing group did 
not practice producing sentences. 

A sentence-level aural comprehension test and a sentence-level 
written production test were given to the subjects in the Pre-test 
and three Post-tests, where a split block design was used. The Pre- 
test was used to eliminate subjects from the study who had 
already demonstrated correct interpretation of object pronouns 
and the ability to correctly produce object pronouns in a sentence. 
The comprehension test, which was biased toward the processing 
group, included interpreting 10 sentences with preverbal object 
pronouns and postverbal subject pronouns, via pictures. The 
production test, which was biased toward the traditional group, 
asked the subjects to complete five sentences b*ised on visual 
representations. Thus, the test was considered balanced. 

The results of ANOVA and post-hoc Scheffe tests demonstrat- 
ed : 

(1) the processing group scored significantly better than the 
control group on the raw scores of both the comprehension and 
production tasks. 

(2) the traditional group significantly outperformed the control 
group only on the raw scores of the production task. 

These results imply that processing instruction and the 
structured input had an effect on how learners process input, and 
thus caused a change in the developing system, and had an effect 
on production, while the traditional instruction resulted in some 
sort of learned language knowledge that did not make its way 
into the developing system and was not tapped for acquisition 
during comprehension. Therefore, these results parallel those in 
VanPatten and Cadierno (1993a). 

The third study of processing instruction was made by Cadier- 
no (1992/1995). She replicated VanPatten and Cadierno (1993a, 
1993b) , only changing the linguistic items under study, where the 
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past tense verb morphology in Spanish was targeted for a total of 
61 university students enrolled in 9 classes of a third-semester 
basic Spanish course. The same patterns of the effects of instruc- 
tion were obtained in her study as well : processing instruction 
had a significant effect on how learners perceive and produce past 
tense forms in Spanish, while traditional instruction had _ n effect 
only on production of past tense forms. Cadierno (1995 : 189-190) 
pointed out several methodological objections against her study : 
(1) similarity of the interpretation task to some of the activities 
in the processing instructional treatment, (2) obscuring possible 
qualitative differences on the production task, (3) no measure of 
spontaneous production included in the study, (4) no post-test 
that covered more than one month after the instructional treat- 
ment, (5) variation of activity types — i.e., the activities in process- 
ing instruction were mostly meaningful and communicative, 
whereas traditional instruction included not only mechanical, but 
also more meaningful and communicative activities, and (6) only 
one linguistic item investigated in the study. 

The result common to these three studies (VanPatten and 
Cadierno 1993a, 1993b ; Cadierno 1992/1995) demonstrate that 
processing instruction seems to be more effective than traditional 
instruction in the case of Spanish linguistic items. This result does 
not advocate the elimination of output practice in FL teaching, as 
Cadierno (1995 : 190) mentioned. Cadierno (1995 : 191) suggested 
that explicit instruction should involve a move from an input- 
based approach that seeks to make changes in the developing 
system to an output-based approach that contains the provision of 
opportunities for output practices in order to develop learners’ 
abilities in accessing their developing system for fluent produc- 
tion. Furthermore, the desirability of having a combined form- 
meaning focused instruction was suggested in Cadierno (1995 : 
191). This was in line with Long’s (1991 : 45-46) “focus on form” 
approach where “the students’ attention is drawn to linguistic 
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elements as they arise incidentally in lessons whose overriding 
focus is on meaning and communication” (Cadierno 1995 : 191) , as 
opposed to a “focus on forms” approach where “instruction seeks 
to isolate linguistic torms in order to teach and test them one at 
a time” (Ellis 1994 : 639) as in regular grammar lessons. 

Sanz (1993) suggested that processing instruction translates 
into improved performance in less controlled communicative 
tasks. Learners asked to narrate short video clips after receiving 
processing instruction in object pronouns demonstrated a marked 
improvement in their ability to use object pronouns in connected 
discourse that was not sentence focused and was “less controlled” 
by the experimenter. 

Tuz (1994) compared comprehension-based instruction with 
production-based instruction by using three groups of Japanese 
junior college students of EFL with regard to psychological verbs 
(e.g., frighten, amuse). The comprehension-based instruction 
(Group C) and production-based instruction (Group P) started 
equally at the presentation stage. The teacher spoke aloud the 
correct sentence corresponding to what was represented by each 
picuture while the subjects looked at pictures and listened. At the 
exercise stage, in the comprehension-based instruction, the sub- 
jects were first asked to match the picture with the sentence 
repeated by the teacher, and they were given correct answers on 
the OHP after each sentence. Second, they were required to match 
written sentences with pictures, and were corrected by the teacher 
after the task. The final exercise was a grammaticality judgment 
task. The answers were then corrected. On the contrary, in the 
production-based instruction the subjects were asked to chorally 
produce the utterance corresponding to each picture. They were 
corrected by the teacher as a group after each attempt. The next 
exercise requested the subjects to write a sentence about the 

picture (answer : Sometimes ) , 

using the present tense verb given by the teacher. The final 
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exercise involved filling in the blank with the correct noun. The 
correct answers were provided by the teacher. The control group 
worked on unrelated reading assignments before the post-tests. 
The results showed that students receiving a comprehension- 
based instructional treatment outperformed students receiving a 
production-based instructional treatment on both a comprehen- 
sion test and a production test. However, it was pointed out that 
these results should be viewed as essentially inconclusive, because 
of the limited length of both the comprehension and production 
tests and no post-tests given to examine the long-term effects of 
instruction. 

To develop fluency and to increase accuracy during access, 
learners must have some opportunity to use the language to 
express messages (VanPatten 1993 : 447). VanPatten (1993 : 447) 
proposed “structured output” where there is a clear focus on 
conveying meaning but where the output is structured by the task 
at hand. Following are the guidelines of structured output activ- 
ities : 

1. Teach only one thing at a time. 

2. Keep meaning in focus. 

3. Someone must “respond” to the learners’ output. 

4. Use both oral and written output. 

5. Move from sentences to connected discourse. 

To the best of the present researcher’s knowledge, there has 
been only one study on input instruction in EFL situations, espe- 
cially in Japan (Tuz 1994), so that this study will be a pioneer 
work. 

2. The Study 

In this research, I will examine which types of instruction plus 
which types of feedback may be effective in enabling learners to 
formulate their own grammar. 
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2.1. Procedures 

2.1.1. Subjects 

120 university students (6 classes) of EFL in Japan participated 
in the whole study. They had studied English only in foreign 
language classroom situations. The present researcher served as 
a teacher in the experiment. The data of 39 students had to be 
excluded from the analysis, since they missed one or more of the 
following : the Pre-test, the treatment, and Post-tests 1, 2, 3. 

2.1.2. Test Items 

Ergative verbs were targeted in this research. Ergative verbs 
(e.g., Burzio 1981, Keyser and Roeper 1984) refer to unaccusative 
verbs, which denote processes lacking volitional control (Perl- 
mutter 1978). Perlmutter (1978) made a distinction between sim- 
ple intransitive verbs, which imply volitional control, and unac- 
cusative verbs, which do not. The operational definition of er- 
gative verbs in this research is that the object of the transitive use 
is the subject of the intransitive use ( Collins COBUILD Student ' 
s Grammar 1991 : 152) . As the following Figure 4 shows, verbs are 
classified as transitive and intransitive verbs. Intransitive verbs 
are divided into ergative verbs and unergative verbs. Ergative 
verbs are with a transitive counterpart. It should be noted that 
Yip (1994 : 127) subcategorized ergative verbs into ergatives with 
a transitive counterpart and without it (e.g., happen, arrive ) , but 
this analysis is not taken into consideration in this research 
because of the operational definition mentioned above. 
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Figure 4 : Classification of verbs 



Verb 




Intransitive verb 



Ergative verb 
(= unaccusative verb) 



with transitive verb 
sink, break 



Transitive verb 
sink, break ; sing, eat 



Unergative verb 
(= simple intransitive verb) 



without transitive verb with transitive verb 
go, pass sing, eat 



For example, 

1. a. John sang a song. 

b. The birds sang in the trees. 

2. a. A gale sank the boat, 
b. The ship sank slowly. 



[transitive] 

[intransitive, unergative] 
[transitive] 

[intransitive, ergative with 
transitiva counterpart] 



2.2. Research Design 

The current experiment had five stages : the Pre-test session, 
the Treatment session, and three Post-test sessions. 

[Stage 1 : Pre-test session] 

The Pre-test, which was 15 minutes long, was given to all the 
subjects (see Appendix). It required the subjects to find and 
correct errors while reading the passages. In No.l there were 3 
ergative verbs checked {start, stop, spill), which included 2 gram- 
matical errors, while No.2 contained 5 ergatives checked {miss, 
shake, break, hurt, stop) , 4 of which had grammatical errors. 
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[Stage 2 : Treatment session] 

The 6 classes were randomly assigned to the following groups 
according to the type of feedback the subjects received. In each 
class, 20 subjects were chosen randomly. Groups Al, A2, Bl, and 
B2 were the experimental groups, whereas Groups Cl and C2 
served as the control groups. The treatment session contained 
both the instruction session and the feedback session. The instruc- 
tion session of each group lasted 10 minutes, and the feedback 
session of experimental groups was 5 minutes long in groups 
receiving explicit metalinguistic information and 2 minutes long 
in Groups receiving positive evidence. 



Treatment = [Instruction session] 
session 

Group Al i input instruction 
(n=20) 

Group A2 • input instruction 
(n = 20) 

Group Bl : output instruction 
(n = 20) 

Group B2 : output instruction 
(n=20) 

Group Cl : input instruction 
(n=20) 

Group C2 • output instruction 
(n=20) 



+ [Feedback session] 

-I- explicit, metalinguistic information 
+ positive evidence 
+ explicit metalinguistic information 
+ positive evidence 
-I- no feedback 
+ no feedback 



Instruction session 

All the groups received either input instruction or output 
instruction in this research. 1 There were 2 treatments provided 
for each instruction (see Appendix). In Treatment 1 for input 
instruction, the subjects were asked to respond to the informa- 
tional content of the input by choosing the appropriate picture 
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that matched the sentence. The meanings were in focus for input 
instruction. The following sentences were read by the present 
researcher : 

(1) The woman died in the bed yesterday. 

(2) The glass was broken when the boy knocked it. 

(3) The alarm clock is ringing suddenly now. 

(4) The ship is sinking in the ocean now. 

(5) The shirt dried off very quickly in the sun. 

By contrast, in Treatment 1 for output instruction, the subjects 
were requested to complete the sentences using the same ergative 
verbs as in input instruction. They were engaged in mechanical 
drills where meanings were not always the focus. 

In Treatment 2 for input instruction, the subjects chose the 
appropriate sentence in the context given, while in Treatment 2 
for output instruction the subjects were asked to translate 
Japanese into English, using the ergative verbs given. 

Feedback session 

After the instruction session ended, feedback was provided to 
each experimental group, though no feedback was given to the 
control groups (Cl, C2) . 

Explicit metalinguistic information was given to Groups A1 
and Bl. This functioned as positive and negative feedback. The 
subjects received the following explicit grammatical explanations 
including sentences of Nos. 2, 3, 5 in Treatment 1 : 

The following sentences were written on the blackboard. 

(2) a. The glass broke when it fell. 
a\*The glass was broken when it fell. 

b. The glass was broken when the boy knocked it. 
b\ The boy broke the glass when he knocked it. 

(3) a. The alarm clock is ringing suddenly now. 

a’. The alarm clock is being rung suddenly now. 
b. The man is ringing the alarm clock suddenly now. 

17 
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(5) a. The shirt dried off very quickly in the sun. 
a’. The shirt was dried off very quickly in the sun. 
b. The woman dried off the shirt very quickly in the sun. 

The subjects in Groups A1 and B1 were given explicit grammat- 
ical explanations as follows : 

The grammatical subject of (2a), (3a), (5a) is not the logical 
subject (i.e., the agent), but rather the logical object (i.e., the 
theme) . The object of the transitive use (2b’, 3b, 5b) is the subject 
of the intransitive use (2a, 3a, 5a) . Sentence (2a’) was not gram- 
matical. The passivized construction was not allowed in the 
context given where tNs falling of the glass caused it to break. In 
Group A1 Sentences (2a), (2b), (3a), (3b), (5a), (5b) matched 
Pictures (2a), (2b), (3a), (3b), (5a), (5b) , respectively ; in Group 
B1 Sentences (2b), (3a), (5a) matched Pictures (2), (3), (5), 
respectively. 

For Groups A2 and B2, exposure to positive evidence existed, 
that is, three grammatically correct sentences were presented in 
Treatment 1 (Nos. 2, 3, 5). They were written on the blackboard, 
and were read by the teacher. No treatment was provided for 
Groups Cl and C2. 

After treatment, all the subjects were told not to study the 
target structure voluntarily. 

[Stage 3 : Post-test 1] 

The Post-test 1 was administered immediately upon the com- 
pletion of treatment (see Appendix). The Post-test 1, which was 
10 minutes long, included Test (A) and Test (B). Test (A) asked 
the subjects to make a grammaticality judgment about ergative 
verbs; Test (B), the correction test, required the subjects to 
correct the verbs assigned in each sentence. Both Tests (A) and 
(B) were designed to elicit the receptive knowledge of learners. 
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[Stage 4 : Post-test 2] 

One week after treatment, the 10-minute Post-test 2 was given. 
It was the same test as the Post-test. 1. 

[Stage 5 : Post-test 3] 

One month after treatment, all the subjects were given the 
10-minute Post-test 3, the same as the Post-test 1 or 2. 

After the Post- test 3, all the subjects reported that they did not 
study the target structure for themselves outside of classrooms or 
receive any instruction in other classes during the investigation. 

2.3. Scoring procedures 

Raw scores were calculated for use in the statistical analyses. 
Regarding the Pre-test, each correct response to 6 test items that 
needed to be corrected was given a score of one point. No 
response to 2 items that should not be corrected was given one 
point respectively. Incorrect response received a score of zero. 
Hence, the Pre-test was worth 8 points. 

Both Test (A) and Test (B) in the Post-test were worth 9 
points. One test item that served as a distractor in each test was 
not counted for statistical analyses. 

2.4. Data Analysis 

The rejection level was set at an ar = .05 level of statistical 
significance, for most analyses. A two-way analysis of varience 
(ANOVA) with repeated-measures design and a one-way 
ANOVA were employed to analyze the means among the groups 
and sessions. 

2.5. Research Question 

The main purpose of this research is to investigate what types 
of instruction-feedback combinations may contribute to the learn- 
ing of grammar. The following two Research Questions are thus 
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addressed in this research : 

Research Question (1) What type of instruction com- 

bined with what type of feedback will 
have an effect on the formulation of 
grammatical knowledge ? 

Research Question (2) If there is an effect for treatment, 

will the effect hold over the three post- 
test sesseions (i.e., immediate, one week 
later, one month later) for learners 
receiving input instruction and output 
instruction ? 



2.6. Hypotheses 

Hypothesis 1 is concerned with Research Question (1), while 
Hypotheses 2-3 are related to Research Question (2) . 

HI : There would be no statistically significant difference in 
accuracy of responses between the experimental groups (Al, 
A2, Bl, B2) and the control groups (Cl, C2). 

That is, the test scores would result in no significant difference 
between the experimental groups and the control groups. 

H2 : There would be no statistically significant difference in 
accuracy of responses among sessions in the experimental 
groups and the control groups. 

This is also a null hypothesis, since no theory or previous 
research explains the difference. The following alternative 
hypothesis will be tested in case the null hypothesis is rejected. 

H3 : The experimental groups would respond significantly better 
in Post-test 1 than in Post-tests 2 and 3. 

It is assumed that a positive learning effect would exist at least 
immediately, owing to the provision of the treatment. 
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3. Results 
3.1. Pre-test 

The Pre-test was worth 8 points. Table 1 shows the means and 
standard deviations by group. Table 2 displays the results of the 
one-way ANOVA in the Pre-test. The results indicate that group 
differences were not statistically significant in the Pre-test 
(F ( 5 ,ii 4 ) = 0.42, ns). Accordingly, any comparative effects due to 
treatment were not related to prior knowledge or language ability 
of any one group. The possibility that the subjects had been 
previously exposeu to instruction on ergative verbs did not consti- 
tute a confounding variable in this investigation. 

In addition, the sufficiently low scores on the Pre-test revealed 
that there was room for improvement that would take place after 
treatment. 



Table 1 : Means and standard deviations by group in the Pre-test 



Group 


n 


Mean 


SD 


Pre-test 








A1 


20 


3.10 


0.70 


A2 


20 


3.30 


0.64 


B1 


20 


3.10 


0.44 


B2 


20 


3.40 


0.66 


Cl 


20 


3.55 


1.02 


C2 


20 


3.80 


1.03 


Table 2 : 


Results of one-way ANOVA in the Pre-test 




SS df 


MS F 


P 


Groups 


7.97 5 


1.59 0.42 


ns 


Residual 


3.78 114 


3.78 








Fcrmcai(s.iu) 


, = 2.29 


3.2. Test (A) in 


Post-tests 






Test (A) was worth 9 points. Table 3 shows the means and 
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standard deviations by group and session. The means of correct 
responses are depicted in Figure 5. 

Table 4 shows the results of two-way repeated-measures 
ANOVA in Test (A). The results indicate that group differences 
were not statistically significant, but session differences (F ( 2 , 2 28 ) — 
11.74, p<.05) and the group by session interaction (F(i 0 , 2 ? 8 )~ 1.68, 
p<.10) were significant. Hence, the simple main effects were 
tested to determine which levels influenced the results. 



Table 3 : Means and standard deviations by group and session in Test (A) 



Group 


n 


Mean 


SD 


Post-test 1 


A1 


20 


5.10 


1.18 


A2 


20 


4.55 


0.92 


B1 


20 


5.40 


1.80 


B2 


20 


4.65 


1.42 


Cl 


20 


4.65 


1.65 


C2 


20 


4.00 


2.02 


Post-test 2 


A1 


20 


4.70 


1.19 


A2 


20 


4.25 


1.95 


B1 


20 


4.65 


1.59 


B2 


20 


4.00 


1.82 


Cl 


20 


4.35 


1.24 


C2 


20 


4.55 


2.01 


Post-test 3 


A1 


20 


4.35 


1.11 


A2 


20 


3.90 


1.89 


B1 


20 


4.35 


1.24 


B2 


20 


3.60 


1.71 


Cl 


20 


4.50 


1.66 


C2 


20 


4.05 


2.18 
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Table 4 : Results of two-way repeated-measures ANOVA in Test (A) 



Source 


S 


df 


MS 


F 


P 


Between subjects 


699.82 


119 








Groups 


26.12 


5 


5.22 


0.88 


ns 


Subjects within groups 


673.70 


114 


5.91 






Within subjects 


248.00 


240 








Session 


21.00 


2 


10.80 


11.74 


<.05 


Groups by session 


15.53 


10 


1.55 


1.68 


<.10 


Residual 


210.87 


228 


0.92 







FcriticaU 5 , 114 ) 2.29 (p<.05) 

FcrltlcaK 2 , 228 ) = 3.07 (p<.05) 

Fcriticai(to,228) = 1-91 (p<.05); 1.65 (p<.10) 



Table 5 illustrates the analysis of the group by session interac- 
tion effect in Test (A). The results show that the differences 
among groups in Post-test 1 were not significant, as shown in 
Table 5. However, F value (F (s> i U ) = 1.85) was so approximate to 
the critical value (F crlt icni( 5 ,n 4 ) — 1-90 ; p<.10) that it may be not 
incorrect to claim that there existed a trend toward statistical 




23 



80 



significance. As shown in Table 5, differences of sessions at 
Groups Al, Bl, and B2 were statistically significant, respectively. 
Additionally, it was found that there was a trend toward statisti- 
cal significance in sessions at Group A2 (F (2 , 228) = 2.30 ; 
Fcrltlcai(2,228) — 2.35, pC.10). 



Table 5 : Analysis of the group by session interaction efffect in Test (A) 





SS 


df 


MS 


F 


P 


Groups at Post-test 1 


23.20 


5 


4.64 


1.85 


ns 


Subjects x Groups at Post-test l 


286.01 


114 


2.51 






Groups at Post-test 2 


7.00 


5 


1.40 


0.48 


ns 


subjects x Groups at Post -test 2 


332.60 


114 


2.92 






Groups at Post-test 3 


11.40 


5 


2.28 


0.78 


ns 


Subjects x Groups at Post-test 3 


335.40 


114 


2.94 






Sessions at Group Al 


5.63 


2 


2.82 


3.07 


<.05 


Sessions at Group A2 


4.23 


2 


2.12 


2.30 


ns 


Sessions at Group Bl 


11.70 


2 


5.85 


6.36 


<.01 


Sessions at Group B2 


11.23 


2 


5.62 


6.11 


<.01 


Sessions at Group Cl 


0.90 


2 


0.45 


0.49 


ns 


Sessions at Group C2 


3.70 


2 


1.85 


2.01 


ns 


Residual 


210.87 


228 


0.92 







Fcrittcai(5.iu> -2.29 (p<.05) ; 1.90 (p <C .10) 

F critics 1 ( 2 . 228 ) ~ 4.79 (p < .01) ; 3.07 (p<.05);2.35 (p<.10) 



Multiple comparisons of simple main effects were made to 
determine which levels were different from each other, using the 
LSD method. The results of between-group comparisons of means 
in Post-test of Test (A) are shown in Table 6, while Table 7 
displays the results of between-session comparisons of means in 
Test (A). As shown in Table 6, Groups Al and Bl were signifi- 
cantly different from Group C2 (p<.10) , in Post-test 1. Therefore, 
it is concluded that the null hypothesis (HI) was rejected in that 
treatments provided to Groups Al (input instruction + metalin- 

24 




The effects of instruction plus feedback on Japanese 
university students of EFL : a pilot study 81 

guistic information) and B1 (output instruction + metalingusitic 
information) were more effective than C2 (output instruction + no 
feedback) , at least immediately in Post-test 1. 

Table 6: Between-group comparisons of means in Post-test 1 of Test (A) 



Mean Group C2 A2 Cl B2 A1 



4.00 


C2 




4.55 


A2 




4.65 


Cl 




4.65 


B2 




5.10 


Al 


** 


5.40 


Bl 


** 



** p<.10 



As illustrated in Table 7, Post-test 1 was significantly different 
(p<.05) from Post-test 3 in Group Al. That is, the effects of 
treatment for Group Al continued over one week. In Group A2, 
Post-test 1 differed from Post-test 3 (p < .10) ; therefore, the effects 
of treatment for Group A2 also lasted over one week. Moreover, 
in Groups B1 and B2 Post-test 1 was significantly different (p< 
.05) from Post-tests 2 and 3 : Groups B1 and B2 had only an 
immediate impact on the learning of grammatical knowledge. 

Accordingly, the null hypothesis (H2) was not supported, and 
H3 was partially upheld in that there existed statistically signifi- 
cant differences amcng sessions in Groups Al, A2, Bl, and B2. 
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Table 7 : Between-session comparisons of means in Test (A) 
Mean Session Post-test 3 Post-test 2 



Group A1 



4.35 


Post-test 3 




4.70 


Post-test 2 




5.10 


Post-test 1 


* 


Group A2 


3.90 


Post-test 3 




4.25 


Post-test 2 




4.55 


Post-test 1 


** 


Group B1 


4.35 


Post-test 3 




4.65 


Post-test 2 




5.40 


Post-test 1 


* 


Group B2 


3.60 


Post-test 3 




4.00 


Post-test 2 




4.65 


Post-test 1 


* 



* p<.05; ** p<.10 

3.3. Test (B) in Post-tests 

The full mark of items in Test (B) was 9 points. Table 8 shows 
the means and standard deviations by group and session. The 
means of correct responses are illustrated in Figure 6. Table 9 
displays the resuits of the two-way repeated-measures ANOVA in 
Test (B) . As shown in Table 9, both group differences and session 
difference were significant, although the group by session interac- 
tion effect was not observed. Hence, the main effects for the 
groups and for the sessions were observed. This implied that the 
groups and sessions influenced the results independently. 
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Table 8 : Means and standard deviations by group and session in Test (B) 
Group n Mean SD 



Post- test 1 



A1 


20 


5.20 


1.47 


A2 


20 


4.90 


1.61 


B1 


20 


6.35 


1.59 


B2 


20 


5.95 


1.28 


Cl 


20 


5.30 


1.42 


C2 


20 


5.30 


2.08 


Post -test 2 


A1 


20 


4.95 


1.47 


A2 


20 


4.20 


1.81 


B1 


20 


6.20 


1.72 


B2 


20 


5.45 


1.36 


Cl 


20 


5.30 


2.03 


C2 


20 


4.85 


2.24 


Post -test 3 


A1 


20 


5.15 


1.74 


A2 


20 


4.30 


2.10 


B1 


20 


6.50 


1.57 


B2 


20 


5.80 


1.47 


Cl 


20 


4.85 


1.71 


C2 


20 


4.60 


2.27 
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Figure 6 : Means of correct responses in Test (B) 




□ 


A1 


OA2 


A 


B1 


X 


B2 


X 


Cl 


- 


C2 



Post - test 1 



Post - test 2 



Post - test 3 



Table 9 : Results of two-way repeated-measures ANOVA in Test (B) 



Source 


SS 


df 


MS 


F 


P 


Between subjects 


928.20 


119 








Groups 


131.58 


5 


26.32 


3.77 


<.05 


Subjects within groups 


796.62 


114 


6.99 






Within subjects 


315.33 


240 








Session 


8.34 


2 


4.17 


3.18 


<.05 


Groups by session 


9.36 


10 


0.94 


0.72 


ns 


Residual 


297.63 


228 


1.31 







FcrltlcaH 5.1 U) “2.29 (p<.05) 

Fcrltlcau 2 , 228 ) = 3.07 (p<.05) 

Fcrltlcal(i 0 , 228 ) ~ 1.91 (p<.05); 1.65 (p<.10) 



Multiple comparisons (using the LSD method) of the main 
effects were made in order to examine which levels were signifi- 
cantly different from each other, since the interaction effects w re 
not obtained. Table 10 shows between-group comparisons of 
me ms in Test (B), whereas Table 11 displays between-session 
comparisons of means. The results show that Group B1 signifi- 
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cantly outperformed Groups Al, A2, and C2. Group B2 did signifi- 
cantly better than Group A2. In addition, on Test (B) the scores 
in Post-test 1 were significantly higher than those in Post-tests 2 
and 3. Therefore, the null hypotheses (HI and H2) were not 
supported, thereby H3 was upheld in that the scores in Post-test 1 
were significantly higher than those in Post-tests 2 and 3. 



Table 10 : Between-group comparisons of means in Test (B) 
Mean Group A2 C2 Al Cl B2 



4.47 


A2 


4.92 


C2 


5.10 


Al 


5.15 


Cl 


5.73 


B2 


6.35 


Bl 



* p<.05 



Table 11 : Between-session comparisons of means in Test (B) 



Mean 


Session 


Post-test 2 


Post-test 3 


5.16 


Post- test 2 






5.20 


Post-test 3 






5.50 


Post-test 1 


* 


* 



* p<.05 




4. Discussion 

The following three hypotheses were tested in this investiga- 
tion : 

HI 1 There would be no statistically significant difference in 
accuracy of responses between the experimental groups ( Al, 
A2, Bl, B2) and the control groups (Cl, C2). 

H2 There would be no statistically significant difference in 
accuracy of responses among sessions in the experimental 
groups and the control groups. 
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H 3 ! The experimental groups would respond significantly better 
in Post-test 1 than in Post-tests 2 and 3. 

The results of Test (A) , which was a grammaticality judgment 
test* revealed that Groups A1 (input instruction + metalinguistic 
information) and B1 (output instruction + metalinguistic informa- 
tion) outperformed Group C2 (output instruction + no feedback) 
in Post-test 1, at p<.10 level. It was also found that the effects of 
treatment for Groups A1 and A2 (input instruction + positive 
evidence) held over the two post-tests (for one week), while 
Groups B1 and B2 (output instruction + positive evidence) had 
only an immediate impact on the formulations of grammatical 
knowledge (p < .05) . 

The results of Test (B) , which measured the subjects’ grammat- 
ical knowledge about ergative verbs by correcting the verbs (the 
correction test) , showed that Group B1 outperformed Groups Al, 
A2, and C2, and that Group B2 got significantly higher scores than 
Group A2 (p<.05). Additionally, it was revealed that the scores in 
Post-test 1 were significantly higher than those in Post-tests 2 and 
3 (p<.05). 

In summary, the present investigation gave mixed results : in 
the grammaticality judgment test, the subjects receiving explicit 
metalinguistic information benefited more than those receiving 
output instruction and no feedback at least immediately, while in 
the correction test output instruction with explicit metalinguistic 
information was more beneficial than input instruction, or output 
instruction with no feedback. Output instruction with positive 
evidence was also found to be more effective than input instruc- 
tion with positive evidence. The result common to Tests (A) and 
(B) demonstrated that explicit metalinguistic information was 
effective in the case of output instruction. This finding suggests 
that it may be advantageous for teachers to provide learners with 
explicit metalinguistic information when they are engaged in 
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production. In addition, it was found that input instruction had a 
temporary effect (for one week) , whereas output instruction had 
only an immediate impact, in the grammaticality judgment test. 
In the correction test, the effect of treatment did not continue over 
one week. 

Therefore, these findings in this investigation are partially in 
accordance with those in VanPatten and Cardierno (1993a, 
1993b) , Cardiemo (1992/1995), and Tuz (1994). Input instruction, 
which aimed at altering the ways in which input is perceived and 
processed by learners, was not found to be more effective in 
enabling learners to alter grammatical knowledge and to refor- 
mulate the developing system than output instruction, which 
manipulated the learners’ productions. It was confirmed, however, 
that the effect of input instruction held longer than output instruc- 
tion, at least in the grammaticality judgment test. Input instruc- 
tion combined with either explicit metalinguistic information or 
positive evidence did not have significant gains in grammatical 
knowledge. 

5. Conclusion 

The present investigation gave mixed results, but partially 
supported the findings obtained by VanPatten and Cadierno 
(1993a, 1993b) , Cadierno (1992/1995), and Tuz (1994). It was not 
found that input instruction had significantly more gains on the 
developing system of learners than output instruction, but it was 
confirmed that output instruction combined with explicit metalin- 
guistic information was more effective than output instruction 
with no feedback. The result also revealed that the effect of 
treatment continued longer for input instruction than output 
instruction at least in the grammaticality judgment test. 

This research pedagogically implies that teachers should keep 
in mind that supplying explicit metalinguistic information is a 
very effective way of altering grammatical knowledge when 
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students practice producing target points, and that the effect of 
treatment may last longer for input instruction than for output 
instruction. 

It should be noted that this classroom research derived from a 
small-scale study (i.e, a small number of test items analyzed in 
each test: only 9 items, a problem of True/False format in the 
grammaticality judgment test : a 50-50 chance of getting correct 
responses, no test given to elicit controlled and spontaneous 
productive knowledge of learners, no long-term test that may be 
given more than one month after treatment) , so that it may be 
improper to make firm conclusions. This research indicates only 
as a pilot study that was first conducted in EFL situations in 
Japan. 

Further research should investigate other aspects of linguistic 
structures to elicit both receptive and productive knowledge, and 
it should examine which will be the most effective methodology— 
which types of instruction (input, output, or input + output) com- 
bined with which types of feedback, with large populations of 
subjects and test items. 

Note 

* I would like to thank Sara M. Luna (Lakeland College, WI, USA) for her 
valuable comments on an earlier version of this research. 

1. In this experiment, the terms ‘processing instruction’ and ‘traditional 
instruction’ were not used, since it is not clear whether learners may actually 
experience input processing in processing instruction, nor whether traditional 
instruction is really traditional in any type of class. Instead, ‘input instruction’ 
and ‘output instruction’ were used. 
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Appendix : TEST 



[Pre-test] (cf. Ellis 1993 : 75) 

Read the following passages. Find and correct errors. 

1. It was 6 o’clock in the morning on a rainy day. I came out of the house 
and was got into my car. It was started easily. As I drove off, a cat rushed out 
in front of me and I hit it with my front bumper. I braked sharply and 
fortunately the car stopped before it crashed into a tree. I was jumped out. 
The cat injured badly, and blood from its head was spilt onto the road. I lifted 
it carefully and as I held it in my arms, it was closed its eyes and it was died 
peacefully. I knew that the cat killed accidentally, but I still was felt respon- 
sible. 

2. It was very windy yesterday. When I came home, I found that the front 
door was opened. I didn’t know why, but at first I thought it was because of 
the strong wind. When I went upstairs, everything in my room was very 
untidy. I guessed somebody had been broken into my house. To my shock, 
100,000 yen was missing, so I decided to called the police. Suddenly, the whole 
room was shaken. The vase fell and was broken. My foot was hurt. I realized 
that the earthquake happened. After 3 minutes, the earthquake was stopped. 
I relieved but in pain and poorer. 

[Treatment] 



Input instruction 

Treatment 1 . Look at the following pictures. As you listen to a sentence. 

decide which picture matches the sentence. Choose a or b. 
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Treatment 2. Which is the best way of continuing the following sentence? 
Choose a, b, or c. 

( 1 ) The ship was very reliable . . . 

a. It was started easily. 

b. I started it easily. 

c. It started easily. 

( 2 ) I was in my study when I began to sense that someone else was present, 
although I could see nobody. 

a. The book I had just closed opened suddenly. 

b. He suddenly opened the book I had just closed. 

c. The book I had just closed was opened suddenly. 

( 3 ) We were in the kitchen eating supper, when something terrible began 
to happen . . . 

a. The house was shaken violently. 

b. The house shook violently. 

c. We shook the house violently. 

( 4 ) I was sleeping well last night. I was supposed to get up at 8 o’clock. But 
something awoke me at 2 o’clock . . . 

a. An alarm clock was sounded in the night. 

b. I sounded an alarm clock in the night. 

c. An alarm clock sounded in the night. 

( 5 ) lam very busy preparing for dinner. When my wife told me to hurry 
up, I replied as follows . . . 

a. I have already put the meat in the oven. It will roast quite 
quickly. 

b. I have already put the meat in the oven. The oven will roast it 
quite quickly. 

c. I have already put the meat in the oven. It will be roasted quite 
quickly. 
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Output instruction 

Treatment 1. Complete the following sentences below using the correct 
form of the verb in the parenthesis, looking at the pictures. 

( 1 ) The woman in the bed yesterday, (die) 

( 2 ) The glass when the boy knocked it. (break) 

( 3 ) The alarm clock suddenly now. (ring) 

( 4 ) The ship in the ocean now. (sink) 

( 5 ) The shirt off in the sun very quickly yesterday, (dry) 
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Treatment 2. Put the following into English, using the verb in the parenthe- 
sis. 

(1) «J|t|cdi«tLfco (sail) 

(2) AfcHufco (open) 

(3) StKMflfc. (shake) 

(4) 0:t£Ll#fb&<, fco (sound) 

(5) i'lzmiZ "CL J ?. (roast) 

[Answers] 

( 1 ) The ship sailed easily. 

( 2 ) The book I had just closed opened suddenly. 

( 3 ) The house shook violently. 

( 4 ) An alarm clock sounded in the night. 

( 5 ) The meat will roast quickly. 

[Post-test] 

Test (A) : Write T if the following sentence is grammatically correct, and 
write F if it is not grammatically correct. 

( 1 ) What was happened here ? 

( 2 ) Onions cook more quickly than potatoes. 

( 3 ) I found that my wallet was missed. 

( 4 ) The rain was dropped from the leaves. 

( 5 ) The mirror shattered during the earthquake. 

( 6 ) The glass broke when it fell. 

( 7 ) The number of traffic accidents was increased last year. 

( 8 ) A ball bounced over the net. 

( 9 ) The house shook violently. 

(10) This skirt was washed well. 
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Test (B) : Complete the following sentences below, using the correct form of 
the verb in the parenthesis. 

( 1 ) When I came home, the front door suddenly because of a 

strong wind, (open) 

( 2 ) His head on the table in the meeting yesterday, (rest) 

( 3 ) This book well last year, (sell) 

( 4 ) This car very nicely yesterday, (handle) 

( 5 ) A woman in the traffic accident yesterday, (kill) 

( 6 ) An alarm clock now. (ring) 

( 7 ) The eggs now. (boil) 

( 8 ) My car into a tree yesterday, (crash) 

( 9 ) The last game very quickly yesterday, since it was a 

no-hitter, (finish) 

(10) The shirt off in the sun very quickly yesterday, (dry) 








